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ABSTRACT 

An 18-month project was conducted to adapt the 
resource room version of the National Center for Research in 
Vocational Education's Career Planning System (CPS) fo»- delivery 
through mi 'icomputers. Specific goals of the project vvere as 
follows: to .dapt a print-based product previously found successful 
with middle school students who displayed mild forms of one of 
several disabilities, to evaluate the use of that adapted version 
with a representative sample of such students at sites across the 
country, to revise the materials on the basis of the evaluation 
results, and to initiate a plan for the national dissemination of the 
final revised version of the materials. After selecting the Atari 800 
microcomputer system with 64K of random access memory as the delivery 
system for the revised version of CPS, project staff converted the 
instructional elements of the earlier version, along with management 
and record-keeping functions, into a 30-disk package. Various other 
printed materials, including instructor's and student's guides, were 
developed for use with the revised system. Based on the results of a 
field test of the revised CPS that was conducted at five sites 
throughout the country, it was concluded that middle school students 
from a variety of special popula1;ior,s found the system interesting, 
enjoyable, and usable. Students in the aggregated exper imental,^group 
gained more knowledfie concerning career planning than did students in 
the aggregated con^:tol group. Recommendations called for wide 
dissemination of Kie revised CPS among different populations at a 
wide range of grade levels. (MN) 
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FOREWORD 



Career planning for handicapped people has become increas- 
ingly important over the last decade because legislation, liti- 
gation, and a growing public awareness have all coinbined to 
promo':e the full participatign of handicapped citizens in the 
mainstream of American life. This project, which has resulted 
in the production of a comprehensive microcomputer-abased career 
planning system for mildly mentally retarded, learning dis- 
abled, and severely behaviorally handicapped middle-school 
students, has thus provided an important and timely tool to 
assist these students as they begin to explore careers and to 
make educational decisions that will have significant impact on 
their adult lives. Moreover, by providing for the delivery of 
career planning experiences through ^^the latest in microcomputer 
technology, the project has ensured that its target students will 
also reap the wide range of learning benefits this technology 
offers. 

Appreciation is expressed to all project staff mer^bers who 
have participaced in the eighteen-month effort to design and 
produce these materials: to Dr. James P. Long and Dr. Leonard 
0. Nasman, who directed the project; to Delia Neuman, Jon 
Persavich, and Wlieeler Richards, graduate research associates who 
participated in the project's instructional design, phase; to 
Patrick Hurley, Brent Miller, Devin Needles, Don Kreinbrink, and 
Dave Keen, who programmed the student materials; to Gail 
Merecickey«> who did the pro jcct • s graphic design; and to Margaret 
Barbee, Carolyn Goodrich, and Cathy Martin, who provided secre- 
tarial support. 

Appreciation is also expressed to the teachers and other 
staff of the five school districts that, participated in the 
project's field test; their cooperation was essential to en- 
suring the quality and validity of the final instructional 
materials." 



Robert E. Taylor 

Executive Director 

The National Center for 

Research in Vocational Education 
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EXECUTIVE SUMMARY 



The National Cenher for Research in Vocational Education, 
The. Ohio State University, has spent the past eighteen months 
adapting the resource room version of the National Center's 
Career Planning System (CPS) for delivery through microcomputers. 
Working from a print-based product previously found successful 
with middle-school students who display mild mental retardation, 
severe behavior handicaps, and learning disabilities, staff have 
reworked all the elements of that product to take advantage of ' 
tht: motivational, managerial, and interactive capabilities of the 
Atari 800 microcomputer system. 

Whereas the microcomputer version of the CPS retains "the 
framework and basic content of thp earlier version, all its 
instructional elements — Introduction, Interest Sort, forty 
Activities, forty occupational Briefs, and Education Plan — as 
well as its management and record-keeping functions have been > 
converted into a thirty-disk software package. In addition, 
an Instructor Guide and a Student Guid e have been written for 
use in conjunction with the computerized material. Various other 
printed materials which include an adaptation plan, evaluation 
instrumentation and evaluation repojrt, an interim report, and 
this final report, as well as project abstracts and a dissemi- 
nation brochure, have also been developed. 

This report has been prepared in order to provide a com- 
prehensive history of the project, which was entitled Adaptation 
of the Resource Room Version of the Career Planning System for 
Use with 'Microcomputers . The final report describes the project 
goals, the procedures followed in order to achieve those goals, 
the results of the evaluation of the adapted materials, and the 
outcomes of all these efforts. The report is of value not only 
to the project sponsor and project staff but also to the field 
sites whose participation was an integral part of the project. 
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INTRODUCTION 



As Stated in the project's -proposc.l , "the basic purpose of 
the project is to produce a coraplete software package of the , 
Career Planning System^ Resource (Room) Education^ for use by 
selected handicapped persons in an effort to aid them in making 
the transition from school to work" (p* 21). Recognizing that 
mildly mentally retarded, behaviorally handicapped, and learning- 
'disabled students need effective career-planning skills in order 
to participate fully in the occupational mainstream of American 
society, the project addressed this basic purpose through the 
achievement of four major project gocils, which are as follows: 

• To adapt a print-based product previously 
found successful with middle-school students 
in the three learning-handicapped groups 
described above 

• To evaluate the use of that adapted version 
with a representative sample of such students 
at sites across the country 

• To revise the materials on the basis of the 
evaluation results 

• To initiate a plan for the national dissemi- 
nation of the final revised version of the 
materials 

These goals guided the planning and implementation of the 
project as described in the following sections of this report. 
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PROJECT PROCEDURES 

The -eighteen months of the project saw a variety of pro- 
cpflures undertaken to plan, implement, and conclude its scope 
of work. These procedures involved (1) the selection of the 
microcomputer hardware delivery system, (2) the development of 
plans to guide both the adaptation of the materials, (3) the 
strategy for their evaluation, (4) the adaptation ii^self, (5^ 
the initiation and conduct of the field test, (6) the data 
analysis, (7) the revision of the product based on that analysis, 
(8) preliminary dissemination efforts, and (9) the preparation 
of the final project documentation. Each of these segments of 
project activity is described in detail in the following sections 

Selection of the Hardware 
After careful consideration of the available hardware 
options, the Atari 800 microcomputer system (ccjnsole, television 
set, and two disk drives) with 64K of random access memory (RAM) 
was chosen as the delivery system for the Career Planning System, 
Microcomputer Version. . In particular, the Atari's ability ro 
provide excellent color graphics and sophisticated sound synthe- 
sis at a reasonable cost made this system especially attractive 
for the purposes of the project. The Atari's graphics capa- 
bilities, for example, enabled project staff to build into the 
courseware a variety of instructional design techniques to 
enhance students' motivation and leai*. .ng. These include (1) a 
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variety of displays with different sizes and placements of letters 
to indicate titles, major and minor headings, objectives, standard 
lists and forms, and- other organizational elements found through- 
out the package; (2) color coding to relate all the components, 
within each individual segment of the package; (3) "player- 
missile" graphics to provide animation apd to allow students'-to 
use joysticks „to. complete various activities; (4) a wide range, 
of color options to allow the design of attractive, realistic 
illustrations; (5^ character-set graphics to enable the rapid 
loading of illustrations and the efficient use of available 
memory; and so on. The Atari's sound synthesis capabilities, -' 
although less significant here for instructional purposes, en- 
abled staff to compose music to introduce various components'" of ^ 
the CPS, to create sound effects to accompany illustrations, and 
to use fanfares as part of the positive feedback provided to 
congratulate students for making correct responses. 

The Atari's 64K of RAM allowed staff to desigp a number of 
sophisticated activities that require substantial memory capa- 
bilities. The use of two disk drives allowed staff to develop a 
comprehensive management system that is one of the most " signifi- 
cant features of the CPS, Microcomputer Version. This system, 
which is described and explained in detail in the CPS Instructor 
Guide, provides each teacher or cotinselor with a number of options 
for creating class records, monitoring each student's progress 
through ^the CPS, and altering that progression as necessary to 
serve student and clafs needs. 

" li 



D evelopment of, the Adaptation P lan . ' 

The first product prepared as part, of the 'project jc&pe of • 
work, the adaptation plan la'd out development procedures '^nd' 
guidelines and specified standards of quality for both the print- 
baned^and the comput'^iz^d project materials. The forty-page- . * 
document was reviewed for\ quality and feasibility by a member of 
I he Faculty for Exceptional Childiren, The^ Ohio State University. _ 
The' Plan includes ( ]> a description of thfe' CP-# (components, - 
organization, sequence of student movement, management ^functions) 
(2) outlines of the I nstructor Guide and Student Guide ;' (3) list- 
ings and descriptions of the 130 separate computer programs to be 
written for the CPS -package; (4) derailed specifications to en-' 
sure the instructional and tQ'chnical quality of the final CPS 
products; (5) a listing of the co^nputer subroutines to bemused 
throughout the CPS; (6) a catalog of the major display formats 
to use for the computerized presentation of various kinds of 
information (e.g.., titles, headings, and subheadings, and so 
fox h) ; and (7) design and programming specifications for the 
various kinds of displays to, be found in the coinputerized simu,- 
lation Activities and occupational Briefs, The Plan, which was 
finalized only after extensive res^£Lrc.h> discussion, and ex- 
perimentation, served as the instructional designers' and 
■ computer programmers' handbook throug ut the development rnase 
of the project. 



Devel opment of th e Evaluation P Ian 
Just as the adaptation plan was develop. to guide the 
creation of thf^ project's instructl-o,nal materials, the evalua- 
tion plan was written to guide ^the project's conduct of its 
field test and data analysis phases. This Plan ,i '^eludes an 
overview of the CPS adaptation project, a description of the 
overall evaluation design for the project, discussion^ of both 
the formative and summative aspects of that design, descriptions 
of the instrumentation and data analysis techniques to be used 
in relation to each kind of evaluation, an^ copies of the pre- 
test and posttest to be administered to the experimental and 
control groups. 

Adaptation of the Materials 
The heart of the CPS adaptation project, this phase was 
also the most extensive and complex. From January through 
August of 19 82, a team of instructional designers and computer 
programmers worked together to adapt each of the individual com- 
ponents ot the Career Planning System, Resource Room Version, to 
take full advantage oi: the managerial and instructional capa- 
bilities of th9. Atari 800 microcomputer system. Project staff 
also developed a selection of printed materials ( Instructor 
G uide and Student Guide ) to support the computerized materials. 

In order to understand the adaptation phase fully, it is 
necessary *to have a general awareness of the organization of the 
CPS and of its instructional components. This informabion. 
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which .is prasented fully in the Instructo r Guide , is summarized 
briefly in the following text and in the accompanying figures. 

The Career Planning 5.'Sl:.om, Microcomputei' Version, in- 
cludes three kinds of materials: (1) thirty floppy disks that 
provide a comprehensive, interactivs instructional component 
that is the main vehicle for student progress through the CPS,, 
as well as an extensive management system for use by the teacher 
or counselor directing the students' experiences; (2) a Student 
Guide for each student that provides reinforcement for student 
learning, a permanent record of the student's experiences with 
the CPS, and a means for the expansion and discussion of these 
materials; and (3) an Instructor Guide that provides the theo- 
retical, technical, and instructional information a teacher or 
counselor needs to implement the CPS. 

The core of the CPS, Microcomputer Version, is fou* 5 in 
the twenty-seven disks that comprise the System's indi' ^dualized 
instructional materials. As illustrated in figure 1, chese 
materials take each student — with teacher facilitation at 
specified points — from initial Introduction and Interest Sort 
activities through as many as ten Interest Areas identified on 
the basis of the student's responses to the fifty items included 
in the Interest Sort. As figure "1 also s'aws, students complete 
their CPS experience by making individual Education Plans in 
order to synthesize the career knowledge and self-awareness 
gained through exploring occupations in the Interest Areas and 
to plan specific activities for the continued investigation of 
favored occupations. 
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Figure L. Career Planninq System Overview 



Figure 2 shows the ten CPS Interest Areas and the four 
representative occupations included in each. These highlight 
interest; + hat middle-school students may currently have or wish 
to explore, rather than focus on traditional occupational clus- 
tering systems. The CPS Interest Areas are designed to help 
students acquire immediate sel f-knowledo as opposed to en- 
couraging them to speculate about the future. The occupations 
included within the Interest Areas were chosen (1) to represent 
rather than completely cover the world of work; (2) to cover a 
range of job tasks requiring visual, verbal, and computational 
skills; and (3) to cover an educational continuum from high 
school diploma to graduate degree and a range of skills from 
entry- jevel. to professional. 

Figure 3 displays the sequence of student movement through 
each Interest Area. First, the students encounter a Prob2~a 
brief introduction to various aspects of the Interest Area— and 
meet four representative worKers from the Area whose jobs the 
students can explore. The students can choose either to leave 
the Interest Area at this point or to complete one of four inter- 
active Activities designed to simulate the job tasks of these 
workers and to give students a "feel" for the actual procedures 
of the jobs. If this Activity excites students' interests in 
the occupation, they can decide to proceed to occupational 
Briefs through which the students "interview" the workers by 
asking questions about information that is important to consider 

9 

16 



1. Advising 



6. Maintaining and Repairing 



• Child care attendant 

• Employment counselor 

• Lawyer 

• Travel agent 



• App 1 i an c e repairer 

• Mechanic 

• Plumber 

• Sanitation worker 



2. Arranging 



Architect 
Florist 
Hair stylist 
Interior designer 



7. Thinking in Pictures 



Cartoonist 
Commercial artist 
Display artist 
Photographer 



i. Building and Mailing 

• Carpenter 

• Drafter 

• Painter 

• Roofer 



8. Using Environmental Information 

• Farmer 

• Fish and game warden 

• Landscape gardener 

• Meteorologist 



4. Doing Clerical Viork 

• Cashier 

• File clerk 

• Secretary 

• Stock clerk 



9. Working with Equipment 



Computer service 

technician 
Cook 

Machinist 

Telephone operator 



5. Helping 



9 Licensed practical 
nurse 

• Police officer 

• Properties manager 

• Waiter 



10. Working with Numbers and Symbols 

• Library assistant 

• Market research codei 

• Medical laboratory 

assistant 

• Teller 



Figure 2. CPS Interest Areas and Occupations 
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FROM INTEREST 
SORT 



FROM 
TEACHER 
INTERVIEW 



TEACHER 
INTERVIEW 




'igure 3. Interest Area Flowchart 
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when making career decisions (e.g., about additional job tasks, 
work environment, educational preparation, salary range, and so 
forth). After exploring as many Activities and Briefs in the 
Interest Area as the students desire--and, in the process, 
completing simple Reaction Forms describing their feelings about 
each— the students talk briefly with the instructor before mdving 
to the next Interest Area on their lists. This brief discussion^^ 
termed an Exit Interview, occurs at' the conclusion of an Interest 
Area. 

This general overview of the CPS organization and materials 
describes the resource room version of the Career Planning System 
as well as the microcomputer version based upon it. Adapting the 
System from one medium to another, however, involved far more 
than the one-to-one translation that the broad similarities of 
the two versions may imply. Rather, the adaptation demanded 
extensive changes? in fact, it required the redevelopment of many 
aspects of the System in order to make the microcomputer version 
valuable in its own right rather than a mere "electronic page 
turner" indistinguishable from its source except for the fact 
that the pages appear on a computer screen. 

As the adaptation effort began, project staff responsible 
for the instructional design of the adapted materials reviewed 
each component of the print-based source material— the Student 
Guide, Interest Sort, ten Probes, forty Activities, and forty • 
Briefs— to determine the most effective reconfiguration of these 
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pieces for delivery through the microcomputer. The resulting 
general desic/h called for .the computerization of the Interest 
Sort, the Probes, the Activities, the Briefs, and most of the 
original S tudent Guide (i.e., the Introduction, most of the 
vocabulary exercises, most of the student record-keeping forms, 
and part of the Education Plan) . The design included reworking 
the rest of tha Guide (i.e., some of the vocabulary exercises 
and record-keeping forms and most of the Education Plan) and 
adding to it a variety of new materials to support and reinforce 
the CPS's core, computerized component. The general design also 
called for the adaptation and redevelopment of the Instructor 
Guide to provide a vehicle for integrating all the various aspects 
of the CPS, Microcomputer Version, into a coherent, easily im- 
plemented, and thoroughly documented instructional package. 

Once the general design was established, project staff be- 
gan to prepare individual components of the CPS for programming. 
This preparation involved (1) reviewing each piece to determine 
what was necessary to make it suitable as a computer-based educa- 
tional act./ity and (2) redesigning each piece as necessary to 
make it interactive according to the technical and instructional 
specifications delineated in the adaptation plan. It was during 
this phase of the project that the display formats and display 
specifications described earlier in this report were suggested, 
tried, revised, and finalized. 
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In addition to creating materials to conform with these 
' specifications, project 'Staff engaged in parallel efforts, as 
well. These involved not only updating information and verifying 
accuracy in relation to spacific Activities and Briefs, but also 
redeveloping materials a^necessary to,; take full advantage of the 
capabilities of the Atari 800 system. • This proved to be the most 
challenging aspect of the adaptation effort, and table 1 illus- 
trates the kinds of alterations in Activities that were wade. 

The Briefs for the CPS occupations were altered signifi- 
car. "-ly as well. Whereas in the original Briefs students read 
interviews with imaginary workers in linear fashion, in the 
computerized Briefs students select from a menu the questions 
they wish to ask these workers. The menu allowed the students 
to choose any four out of six questions, in any order. 

With the adaptation of the Activities and Briefs well under- 
way, staff began preparing the other components of the CPS for 
programming. In preparing these pieces (i.e., the Introduction, 
Interest Sort, and Education Plan), as in preparing the Activities 
and Briefs, staff specified the content and kind of display for- 
mat for each display and suggested the graphics to use in each 
program. 

After a component wat. prepared, one of the project's com- 
pute- programmers began to program it. The relationship between 
instructional designers and programmer staff immediately beca.ae 
interactive, since the programmers were often able to suggest 
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TABLE 1 



EXAMPLES OF ORIGINAL AND ADAPTED 
CPS ACTIVITIES 



OCCUPATION 



ORIGINAL 
ACTIVITY 



ADAPTED 
ACTIVITY 



Lawyer 



Interior designer 



Secretary 



Landscai.'3 gardener 



Licensed practical 
nurse 



Student reads about 
traffic accident 
and compiles report. 



Student cuts and 
pastes furniture 
shapes into out- 
lines of rooms. 



Student writes and 
types letter for 
employer. 

Student circles 
problems (e.g. , 
dead tree, broken 
wall, etc.) on 
picture of park. 



Student takes other 
student's pulse 
using a watch. 



Student witnesses 
accident, reads 
basic information 
about it, writes 
report, and deaides 
whether to sue on 
behalf of client.. 

Student uses key- 
board to place 
pieces of furniture 
in outlines of 
rooms . 

Student schedules 
employer's appoint- 
ments for one day. 

Student uses joy- 
stick to move 
"player-missile" 
graphics character 
to identify problems 
in park. 

Student takes own 
pulse using digital 
timer built into 
computer display. 



15 



22 



ways to make the materials more attractive, more interescing, 
and more thoroughly capable of taking advantage of the 
microcomputer. 

The computer-programming staff were also responsible for 
designing the CPS management system. This comprehensive record- 
keeping system allows teachers to create and update a class 
roster, to obtain information about each student's progress 
through the CPS, to copy student master and data^' disks, and to 
interrupt the normal flow of the CPS to allow individual students 
the flexibility to return to Interest Areas previously explored. 
Figure 4 displays all the functions included in the CPS manage- 
ment system, each of which is described in detail in the 
Instructor Gu i de . 

Development of the I nstructor Guide and the Student Guide 
began when the adaptation of the computerized material reached 
the stage at which the implementation details of the CPS, Micro- 
computer Version, could be fully understood by project staff and 
could therefore be clearly communicated to others. The Student 
Guide , the first of these two pieces to be developed, is an 
eighty-eight page booklet that provides students with their only 
hard-copy record of the CPS ( ,<perience. Designed to serve a 
variety of purposes throughout that experience, the Student 
Guide (1) introduces students to the CPS and to the procedures 
for loading a disk; (2) provides work sheets for practice and 
reinforcement for the concepts and vocabulary presented in the 
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INSTRUCTOR 
OPTIONS 
DISPLAY 



A. CLASS ROSTER ^ 



B. STUDENT INTEREST 
SORT RESULTS 



C. STUDENT PROGRESS 
INFORMATION 



D. REACTION FORM 
DATA 



E. BACK-UP STUDENT 
DATA DISK 



F. INTEREST AREA 
CHANGE 



G. ADD STUDENT 
TO ROSTER 



H. EXTENDED INSTRUCTOR 
OPTIONS 



I. EXIT TO CPS 



\ 



A. FORMAT CLASS 
DATA DISK 



B. COPY STUDENT 
MASTER DISK 



C. CREATE CLASS 
RECORDS 



D. EXIT TO DISK 

OPERATING SYSTEM 



E. RETURN TO 
MAIN MENU 



Figure 4. 
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computerizdd Introduction; (3) includes a glossary of terms 

(e.g. wage, salary, college, apprenticeship) used in the Briefs; 

(4) provides a pormanent record of the students' Interost Sort 

" •■ 

results; (5) includes a supply of Reaction Forms on which students 
can expand their answers to the summary questions on the com- 
puterized Reaction Forms, as well as a supply of Career Plan 
Pages on which students can copy the cours.es to take, activities 
to pursue, and so forth, that are presented in the computerized 
Briefs; (6) :>rovides a permanent record of all the jobs (to a 
maximum of > =n) in which the students' computerized Reaction 
Forms indicate a high degree of interest; and (7) concludes with 
a section of Education Plan p- es , each comprised of eight 
questions designed to guide th- instructor/student planning 
process that is the culminati©n of the students' Career Planning 
System experiences. ,^ 
The final document prepared as part of the materials adapta-^ 
tion phase of the project is the Instructor Guide , a sixty-page 
manual that explains what the CPS is and how to use it. Table 2 
illustrates the contents and sequence of the I nstructor Guide . 

Designed to provide all the information a teacher or 
counselor needs to implement the CPS, the Instructor Guide 
provides (1) a basic awareness of the goals, purposes, conceptual 
bases, and developmental history of the CPS, Microcomputer 
Version; (2) a description of the content, organization, and 
sequence of student activities of the CPS; (3) a detailed 
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TABLE 2 



CONTENTS OF INSTRUCTOR GUIDE 



Intiroducing the CPS 
What the CPS is 

Why handicapped students should use 
' ' the^ CPS . ^ 

What advantages the microcomputer 

version offers 
Materials 
Organization 



Using the CPS 

Technical procedures 
Instructional procedures 

Supplementing the CPS 

Additional activities 
More information 



explanation of the procedures for using the management component 
of the CPS and for guiding .^students through the instructional 
component; (4) suggestions for group activities to supplement 
and expand upon the individualized core activities of the CPS? 
and- (5) sources of additional information about careers for 
instructors and students who wish to pursue various topics in 
more detail. The Instructor Guide is thus the vehicle that 
integrate all the aspects of the Career Planning System, Micro- 
computer Version, into a coherent, easily implemented, and 
thoroughly documented instructional package. 
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A fi.eld'^test edition of the Instructor Guide also served in 
project evaluation efforts. A section of this edition (entitled 
"Evaluating the CPS") included two of the evaluation insLru- 
ments — Exit Interview Forms and an Instructor Log — and in~ 
. structions for completing th;^ pretests and posttests that 
provided the pftrimary summative data for the project. 

Initiation and Conduct of the Field Test 
Preparations for the field test of the Career Planning 
System, Microcomputer Version, began early in the project, when, 
contacts^ were made with a number of school districts across the 
country in an effort to identJ fy five suitable field test sites. 
Negotiations with the following districts resulted in the place- 
ment of the materials in schools within or adjacent to major 
population centers distributed throughout the United States, as 
follows: 

• Boulder Valley Public Schools 
Boulder (Denver), Colorado 

• Brentwood Public Schools 
Brentwood (St. Louis) , Missouri 

• Columbus Public Schools 
. Colu'^bus, Ohio 

• Farmers Branch — Carrollton I.S.D. 
Carrollton (Dallas) , Texas 

• Freeport Public Schools 
Freeport (New York City) , New York 

The field test itself was formally initiated with a full- 
day user training workshop conducted by projtct staff at the 
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National Center on August 18, 1982. One or more representatives 
from each of the participating school districts attended this 
workshop to learn about the CPS, as well as about how to use it 
witl- their students and to collect the requisite data during 
the testing phase. Figure "5 displays the specific activities 
accomplished during the training session. 

Complete sets of hardware, software, and printed materials 
were shipped to • the sites during the first week of September 1982' 
so that the field test could begin as early in the fall term as 
possible. After administering the pretests, field test teachers 
guided their students' use of the materials until the first week 
in December, when they administered the posttests and returned 
all the appropriate materials to the National Center for analysis. 

The implementation of the field test each site reflected 
the specific characteristics of the studencd, setting, and 
staffing at the site. In Boulder, for example, the student 
participants displayed the full spectrum of handicapping 
conditions — learning disabilities, mild mental retardation, and 
behavioral handicaps — for which the materials were designed. The 
hardware was housed in a special glassed-in area within a media 
center and the principal implementor was a retired teacher 
employed as a consultant specifically for this task. Students 
were excused from their regular classes to work with the CPS 
materials, and each spent approximately ten hours on this project 
over the course of the field test. 
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iM[ NMiONAL mm 

m RtSlARCH IN VOCATIONAL EDUCATION 



1960 Kenny Road 
Colurnbui. Ohio 43210 



AGENDA 
TR7vJNING SESSION 
CAREER PLANNING SYSTEM 
MICROCOMPUTEP ADAPTATION PROJECT 

AUGUST 18, 1982 



Phone 614-486 3655 
Cdblf CTV0CEDOSU/C(Muml)uv Ohio 



I . INTRODUCTIONS 
II. OVERVIEW OF CPS PROJECT 

III, SOFTWARE ORGANIZATION 

A . Incroduction 

B. Interest Sort 

C . In teref^t' A/'.-ajr 

D. Education Plan 

E . Instructor Options 

IV. ACTIVITY DEMONSTRATIONS 

V. STUDENT DISK PREPARATION 

VI. INSTRUCTOR GUI DE/ STUDENT GUIDE 

VII. PILOT TEST DATA AND RECORD-KEEPING 

III. vS\STEM TRV-OUT 

IX. HARDWARE SET-UP 

X. WPjP\P-UP 



Jim Lone 
Len Nasman 
Len Nasman 



{ Hands-on ) 
Pat Hurley 
jelic; Nouman 
Jim Long 
(Hands-on ) 
Len Nasman 
Jim Lena 



Toll Free Numl:)er - (600} 848- 481 5 

-.. , , r— . ~w ■ . ■— ~ -^-^ . .. .. , ... . — — -'■--» ■■ ' ' — 

Figure 5. Agenda of CPS Training Session 
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In Brentwood, students with learning disabilities and be- 
havioral handicaps worked on the CPS materials in a self- 
contained classroom under the direction of a teacher of remedial 
reading and math. While individual students worked on the com- 
puter at the back of the room, four or five other students, .worked 
at tables on their regular remedial assignments. Treatment-group 
students spent approximately four hours a week using the CPS 
materials. 

All the participants in Carrollton were learning disabled 
students who were excused from their special education, elective, 
and academic classes to work on the CPS materials in a separate 
roora under the direction of an educational diagnostician. The 
amounts of time individual students spent working with the mate- 
rials varied according to the students' abilities and to the 
class periods during which students were scheduled, with each 
student spending an average of approximately ten hours with the 

I .... 

materials during the field test period. 

' The testing in Columbus was conducted at a school for 
severely behaviorally handicapped students under the direction of 
the 'school's work-study coordinator. Students were called in- 
dividually to a separate room and allowed to work on the materials 
until it was time to return to their regular classes. The mate- 
rials were in use for two and a half days a week, with each student 
working froi.^ forty to sixty minutes or more each week. 
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Participants in Freeport were severely behaviorally handi- 
capped and learning disabled students, each of whom worked on 
the CPS materials in a self-contained classroom for approximately 
thi.rty-five minutes once a week. Each student was excused from 
regular classes to work individually with one of two special 
education teachers. 

Analysis of the Data , , 

Both summative and formative data were collected through 
the field test phase of the project and were subsequently analyzed 

< 

to determine t'^e effectiveness ©f the CPS, Microcomputer Version, 
as well as to guide the revision process by identifying the 
particular strengths and weakr^esses of the instructional package. 

As described extensively in the evaluation report, summative 
data were collected primarily through a pretest-post test design 
involving an experimental group of forty-nine learning-handicapped 
middle-school students and a comparable (control) group of twenty- 
three students. Teachers' rankings of the materials were col- 
lected thi.ough an "Instructor Log" and were used to obtain summa- 
tive measures of the teachers' perceptions of the quality and 
utility of the materials. The Wilcoxon Matched-Pairs Sign Test 
was used in order to analyze the pretest-posttest data, and means 
of the teachers' rankings on the Instructor Log were computer in 
order to obtain .an understanding of the teachers' perceptions. 
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The results of the analysis of both types of simwiative data 
are provided in detail in the evaluation report. Conclusions 
and recommendations based on the analysis are presented briefly 
in a subsequent section of this final report. 

The evaluation report also describes in detail the collec- 
tion of formative data through a variety of strategies (i.e., use 
of an Instructor Log, an Exit Interview Form with experimental- 
group students, biweekly telephone calls from project staff to 
each site, and several site visits) as well as the analysis of 
this data to identify both the strengths of the CPS package and 
those aspects of it in need of revision. Working through seven 
Instructor Logs, 182 Exit Interview Forms, and extensive notes 
from the more informal telephone and personal" ccnversaLionG, 
project ctaff uncovered patterns of teacher and student responses 
indicating oath that the students were motivated and enriched by 
their work with the Career Planning System, Microcomputer Version, 
and that the materials could be made even more effective for 
learning-handicapped students. Field test teachers and students 
offered specific recommendat ^ ons for improvement and suggested 
such improvements through the patterns of thei.r responses as well. 
These data were used to guide the revision effort and to improve 
the overall quality of the CPS, Microcomputer Version, package. 

Revi sion of the Materials 
This phase of the project involved the incorporation into 
the CPS package of two. kinds . of improvements: those recommended 
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by the field test participants and those recognized as beneficial 
by project staff. Guided by the data obtained from the field, 
project staff reworked various components of the CPS materials 
to make them less wordy and more readable, and less compLex and 
more direct. A good deal of the computation required in various 
Activities was eliminated, and ,what remained was *nade simpler by 
recasting it in smaller steps with more explicit directions. In 
addition, questions that were sometimes included to test students' 
awareness of the occupation- related content inherent in some 
Activities were eliminated, and the Activities were rev as 
necessary to enable the students to complete them succe'" ally 
without having to master significant amounts of technio- content. 

Preliminary Efforts at Dissemination 
In keeping with the stipulation of the sponsor that the 
National Center initiate plans for the national dissemination of. 

the Career Planning System, Microcomputer Version, project and 

field staff engaged in a variety of tasks designed to set the 
stage .for a full-scale dissemination effort. These tasks in- 
cluded project staff's preparing project abrjtracts and a project 
brochure, presenting the project and its results at various 
meetings, and contacting agencies and organizations likely to be 
interested in marketing and distributing the final CPS instruc- 
tional package. Field site staff members were involved in d: 
semination efforts through presenting both formal and informal 
demonstrations for local teachers and administrators interested 
in the CPS materials. 



Early in the project, an abstract describing the purposes, 
anticipated procedures, and expected outcomes of the effort was 
prepared to publicize the project. Copies of this abstract were 
sent ou': in response to specific requests for information and 
were distributed to persons the project staff thought would be 
interested in the project. Toward the end of the project, a 
revised and updated version of this abstract was prepared in order 
to enable the National Center to respond itKDre appropriately to an 
increasing number of requests for information. Distribution of 
this abstract continues to be handled by the National Center's 
Program Information Office (PIO) , an internal support function 
designed to provide maximum visibility for National Center projects, 
services, and publications. 

The PIO also distributes a brochure about the Career Planning 
System, Microcomputer Version, designed to describe this product 
to potential purchasers. Written and designed by project staff, 
the'- brochure is an eight-panel folded marketing piece that high- 
lights the nature, content, purposes, implementation procedures, 
and availability of the revised CPS instructional package. 

Throughout the duration of the scope of work, project staff 
took advantage of a number of opportunities to publicize the project 
at various professional meetings. Early in the project, staff 
described the plans for the effort at the first annual Educa- 
tional Computer Fair sponsored by the Educational Computer 
ConsortiuF Ohio. Invited to the second annual fair to provide 
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updated information on the project, staff returned to Cleveland 
in October 19 82 to give another presentation. 

Staff also presented a description of the project at the 
Hodaon-Benef icial Colloquium on Future Perspective and Realities: 
Career Development for Exceptional People. Sponsored by the 
Johns Hopkins University, this event was held in Baltimore, 
Maryland in May 19 82. 

Finally, project staff presented "Career Planning Meets the 
Micro: A Demonstration" at the Council for Exceptional Children's 
National Topical Conference on the Use of Microcomputers in Special 

v.- 

Education in Hartford, Connecticut in March 1983. Staff also sub- 
mitted a copy of that presentation for inclusion in ERIC's 
Clearinghouse on Handicapped and Gifted Children. Working under 
the sponsorship of the National Center (rather than under the 
grant that funded this project) , staff will make that same pre- 
sentation at the Council for Exceptional Children's Sixty-First 
Annual International Convention in Detroit in April ■19-8-3-. 

During the final six months of the' project, project staff 
investigated a number of possibilities for the eventual commer- 
cial marketing and distribution of the CPS materials. Possi- 
bilities include distributing these materials through the National 
Center's own cost-recovery operation; through the services of 
LING Resources, Inc. (a function of the Market Linkage Project 
for Special Education sponsored by the U. S. Department of 
Education); and through the Atari Corporation. At present, plans 
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for dissemination are being finalized with the Atari Corporation, 
which bas > indicated verbally to project staff that one or more of 
three possible avenues for marketing and distribution by Atari 
are near- certain ties . 

Plans are for the National Center to submit copies of the 
project deliverables to Atari, after having recieved sponsor 
approval of the deliverables and sponsor approval to so submit 
them. It is expected that, after having examined the products, 
Atari will suggest that the National Center enter into an agree- 
ment for marketing and distribution rights. 

The CPS, Microcomputer Version, has been protected by copy- 
right since the start of the field test in order to make the 
.product more attractive to such commercial marketing and dis- 
tribution companies as Atari. 

It is expected that after the conclusion of the project, the 
CPS, Microcomputer Version, will be submitted by the National 
.-■Centar .. for...apprQV-al..of ..the--..federal.-Joint...Diss.emin.at Review. 
Panel (JDRP) . Such approval, if obtained, will make the product 
even more attractive to commercial marketing and distribution 
companies. 

Field site staff have played an important role in getting 
product dissemination efforts under way. . Each site agreed at the 
outset of the field test to serve as a regional demonstration 
center for the CPS materials, and in that context each has 
publicized then) in various ways. For example. Boulder, Colorado, 
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staff demonstrated the materials for a number of audiences in- 
cluding the district's special education teachers, participants 
in a state career*' education conference, and a number of small 
groups of teachers and other staff* Columbus, Ohio, staff members 
hosted a workshop at which local administrators and work-study 
coordinators were introduced to the CPS materials, and have also 
demonstrated them to a number of other district teaching and 
administrative personnel. Brentwpod, Missouri, staff invited all- 
district personnel working in special education and/or in guidance 
to an organized open house to view the system. In Freeport, New 
York, field staff invited fifty-six nearby school districts, to 
attend an afternoon session in career awareness for special 
education students that featured the CPS, Microcomputer Version. 
At this session an oral presentation was made by a twelve-year-old 
special education studant to the visiting teachers and counselors. 
Similarly, the Carrollton, Texas, field staff' devised a way for 
all special education personnel . the., .district .and in surrounding 
districts to view the system in operation. Thus, all five pilots- 
test sites have assisted in the dissemination effort, as agreed. 

Do cumentation of Project Efforts 
Documentation of the progress of the project has been 
accomplished through the submission of two formal documents, one 
a. interim report and the other this final report. The interim 
report, v/hich was submitted on Uecembex 1, 19 82, included a 
cover letter describing all major accomplishments, concerns, and 
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modifications over the first year of the project as well, as 
copies of all the printed products that project staff had\ 
developed by that poin^ — the adaptation plan, the Student Guide , 
and the I nstructor Guide , This final report provides a detailed 
history and description of every aspect of the project and \ 
presents a comprehensive discussion of its purposes, procedures, 
evaluation findings, and final results. 
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EVALUATION RESULTS 
As described in detail in the CPS evaluation report and 
briefly in the "Project Procedures" section of this report, the 
Career Planning System, Microcomputer Version, materials were 
field tested in five sites across the country in order to collect 
both formative and summative data on the quality an^ utility of 
•the materials. Project staff analyzed both kinds of data in 
order to determine thp overall effectiveness of the materials in, 
their unrevised state and to identify improvements that aould 
enhance the quality of the revised version. The results of those 
analyses, which are discussed extensively in the evaluation report 
are summarized next. 

Conclusions 
The main conclusions are as follows: 

• Middle-school students from a variety of special 
populations (mildly mentally retarded, learning 
disabled, and behaviorally handicapped) found the 
system interesting, enjoyable, and Usable. 

• Teachers of such students found the system bene- 
ficial for teaching career planning and for 
encouraging and facilitating career guidance 
interviews. 

• Students in the aggregated experimental group 
gained more knowledge (about careers, about self 
with respect to careers and career planning, and 
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about career planning in general) than did 
students in the aggregated control group. 
The difference was statistically significant 
at the .05 level. 

• The system is usable for a wider audience than 
the group with which it was pilot-tested. 

• The system's various programs, if made accessible 
by means of a simple menu device, are valuable 
even without the management system. 

Re commendations 
The main recommendations are as follows: 

• The CPS, Microcomputer Version, should be, .widely 
disseminated and used among different populations 
(special education students and others) at a wide 
range of grade levels. 

• An alternative management system for CPS, Micro- 
computer Version, should eventually be prepared 
to allow access to any program through a simple 
menu device, v/ithout requiring the user to first 
pass through the Interest Sort. 

• Print-based materials should not be adapted to th 
microcomputer; the inevitable tendency is to make 
the microcomputer an electronic page turner. 



The use of a microcomputer with a videodisc 
player (or similar device) should be investi- 
gated to provide bette' sound and graphics 
while (possibly) reducing, the programming time. 
When possible, systems should not require the 
simultaneous use of the joystick and the keyboard.i 
When possible, hard copy, such as the results of 
the. Interest Sort, should be prepared by a printer 

attached to the microcomputer, rather than by 

i 

students or teachers who make handwritten entries 
in an accompanying manual. 

The research design for evaluating suoh projects 
should involve larger pilot-test groups and p. 
■greater number of questions for each category 
of information investigated. 

The length of the pilot-test period for such 
projects should be one school year,, rather than 
one quarter, in order to enable more students 
to complete the entire system. 
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• The use of a microcomputer with a videodisc 
player (or similar device) should be investi- 
gated to provide better sound and graphics 
while (possibly) reducing the programming time. 

• When possible, systems should not require the 
simultaneous' use o"" the joystick and the keyboard. 

• When possible, hard copy,, such as the results of 
the Interest Sort, should be prepared by a printer 
attached to the microcomputer, rather than by 
students or teachers who make handwritten entries 
in an accompanying manual. 

• The research design for evaluating such projects 
should involve larger pilot-test groups and a 
greater number of questions for each category 

of information investigated. 

• The length of the pilot-test period for such' 
projects should be one school year, rather than 
one quarter, in order to enable more students 
to complete the entire system. . 
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PROJECT OUTCOMES 
The major outcome of the project is , of course^ the complete 
instructional package entitled the Career Planning System^ Micro-- 
computer Version, This as well as the other project outcomes are 
listed in table 3. The reader is referred to earlier sections of 
this report for descript* »ns of each of those prircipal products 
of the project. 

One outcome of the project that cannot be listed along with 
the deliverables is the development of the increased ability of 
project staff to design instructional packages for microcomputer- 
based education for exceptional students. A new and exciting 
field, mi rocomputer-based education offers particular promi.se 
for learning-handicapped students / who can profit greatly from 
the individualization of instruction, the opportury.ty to act 
effectively upon the environment, and the possible bypassing or 
compensating for personal deficits through new and emerging 
electronic technology. National Center staff who had the oppor- 
tunity to work on this project have developed knowledge and skill 
that will enable them to make valuable contributions ^ to the voca- 
tional preparation of handicapped students through t:he principles 
and techniques of this field. 
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TABLK 3 



SUMMARY OF PROJECT OUTCOMES 



OUTCOME 



1. Career P" ining System^ 
Microco'..puter Version , 
Revised Edition 

• Thirty floppy disks 

• Student Guide 

• Instructor Guide 



2 • CPS A daptation Plan 



3. CPS Evaluation Plan 



4. Interim report 



5. CPS Evaluation Report 



6. Project abstracts 



7. Product brochure 



8. Final report 



DELIVERY DATE 



March 1983 



< 



April 1982 



September 19 82 



DeceiTiber 1982 



February 198 3 



Fall 19 82 and 
Winter 198 3 



March 1983 



March 19 8 3 
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